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METHOD, SYSTEM, AND PROGRAM FOR 
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BACKGROUND OF THE INVENTION 
5 1. Field of the Invention 

The present invention relates to a method, system, and program for accessing a 
file in a file system by processing a data structure indicating the presence of 
preexisting files having the same name as a file to access. 

10 2. Description of the Related Art 

In data storage systems, before a file is stored, the file system is searched to 
determine if there is already a file having the name of the file to store. The file system 
includes the logical structures and software routines used to control access to files 
stored on a non-volatile storage medium, such as a hard disk drive, tape, optical disk, 

1 5 etc. In a file system, the files are stored in directories which provide a hierarchical 
arrangement of data. Each file or directory on the media can be uniquely identified 
using two pieces of information: its filename and the path in the directory that is 
traversed to access the file. The are various file systems in use (FAT, Unix, and 
ISO9660 and UDF for CDROMs and DVD devices). 

20 Each file representation exists in a directory structure specific to its file 

system. To add a file to the file system, the directory must be searched to determine if 
the file already exists on the media. These directory access operations can have a 
significant impact on performance because storage media such as hard disk drives, 
tape, and optical disks are relatively slow devices due to the need to mechanically 

25 move the read head to different locations in the storage medium. In fact, such disk 
read operations can consume significant time. 

One current solution to this problem is to maintain a list or database table of 
all file names in the file system. In this way, when a file write request is received, the 
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list can be checked to determine if the file to store or update is already in the file 
system. Such an approach avoids the burdensome operation of expending time doing 
I/O operations to search the file system. One problem with this approach is that the 
data structure to store the file names can be particularly large, especially with file 

5 systems that support long file names, e.g., 256 characters long, and increasing. As the 
storage capacity increases and the file name length increases, the usefulness of this 
technique decreases because the table needed to store the name of each file may 
increase to a point where it is no longer feasible to maintain in cache. In such case, 
the table would have to be stored on the non- volatile storage medium, and have to be 

1 0 accessed using the slower performing disk drive actuator and head. 

Thus, there is a need in the art for an improved, method, system, and program 
for determining the current files in the file system. 

SUMMARY OF THE PREFERRED EMBODIMENTS 
15 If the majority of file access operations update existing files, then the directory 

search cannot be avoided. However, in an application where the primary file access is 
to add new files (data archive), the search is primarily to validate that the file does not 
already exist. Data archival also tends to produce new files at a very high rate. This 
causes archival systems to suffer major performance degredation as the number of 
20 files in the directory increases. 

To overcome the limitations in the prior art described above, preferred 
embodiments disclose a method, system, and program for processing an input file in a 
file system, wherein the input file has an input file name. A function is applied to 
map the input file name to a value. A data structure is processed to determine 
25 whether there is a preexisting file in the file system having a name that maps, 

according to the function, to the same value to which the input file name maps. Two 
files that map to a same value according to the function are capable of having a same 
name. 
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In further embodiments, the function is a hash function that maps the input file 
name to an integer value. In such case, the data structure includes an entry for each 
possible integer value capable of being generated from the hash function. 

In yet further embodiments, the data structure is processed to determine 
whether there is a preexisting file by determining whether the entry for the integer 
value to which the input file name maps indicates the presence of one preexisting file 
mapping to the same integer value as the input file name. 

In still further embodiments, the data structure is a one-dimensional array. 
Each entry is capable of having one of two values and the entry is set to a first value if 
there is one preexisting file name in the file system that maps to the integer value for 
the entry. In such case, determining whether there is one preexisting file comprises 
determining whether the input file name maps to one entry that has the first value. 

Preferred embodiments provide a method, system, and program for 
determining from a data structure a possible presence of a preexisting file in the file 
system having the same name as an input file. Preferred embodiments utilize a 
function, such as a hash function, to map file names to values that can be represented 
using substantially less space than the file name. The data structure maintains 
information on values to which preexisting files map. In this way, upon receiving a 
write operation or other file request, a determination can be made from processing the 
data structure, such as the hash table in cache, as to whether there is a preexisting file 
that maps to the same value as the input file. This may indicate that the preexisting 
file has the same name as the input file. 

After determining that the input file maps to a value to which one preexisting 
file maps, the file system can be scanned to determine if there is a file with the same 
name as the input file. If not, then a file can be added for the input file. Otherwise, if 
there is already a file with the same name, then writing the input file would comprise 
updating the preexisting file with the same name with the content of the writes. 
Preferred embodiments provide a system to process file operations, such as a write 
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operations, by first checking the table which would definitely indicate if there was no 
file having the same name. This allows the operating system to avoid, in most cases, 
having to search the entire file system each time data is written to the file system. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Referring now to the drawings in which like reference numbers represent 

corresponding parts throughout: 

FIG. 1 is a block diagram illustrating a computing environment in which 

preferred embodiments of the present invention are implemented; and 

FIG. 2 illustrates logic to process a write request in accordance with preferred 

embodiments of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
In the following description, reference is made to the accompanying drawings 
which form a part hereof and which illustrate several embodiments of the present 
invention. It is understood that other embodiments may be utilized and structural and 
operational changes may be made without departing from the scope of the present 
invention. 

Problems with Current Archival Storage Systems 
Current archival storage systems back-up files in a mass storage device, such 
as magnetic tape cassettes, optical disks, etc. It has been found that most of the write 
operations to files in an archival storage system comprise writing new files as 
opposed to updating existing files. Files are often written once to archival storage and 
never subsequently accessed to read or update. However, for each new write 
operation, the operating system must scan the entire file system to determine whether 
the file that is the subject of the write operation is a new file or existing file. If the 
file being written already exists, then the operating system updates the existing file 
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with the write data. Otherwise, if the file to write does not currently exist in the file 
system, then the operating system creates a new file in the file system to archive the 
write data. 

Although it is likely in archival storage systems that a write operation is going 
5 to create a new file, the operating system nonetheless performs the time consuming 
operation of scanning the entire file system, which may require reading directory 
information from fragmented storage locations. The operating system must determine 
whether a same named file exists in the system to avoid a situation where there are 
two files with the exact same name. The time needed to scan increasingly large file 
10 systems can significantly affect the performance of write operations. For this reason, 
there is a need in the art for an improved system for determining whether a file 
already exists in the file system. Such an improved system would be particularly 
useful for archival storage systems where most write operations are to new files and, 
thus, do not require a search of the file system for a matching file name. 




Computing Environment 
FIG. 1 illustrates a computing environment in which preferred embodiments 
are implemented. Computer system 2 may comprise any computing system known in 
the art, e.g., workstation, personal computer, mainframe, palmtop, laptop, server, etc. 

20 The computer system 2 includes an operating system 4, such as MICROSOFT 

WINDOWS, AIX, OS/390, OS/2, MVS, UNIX, LINUX** etc. The computer system 
2 further includes a file system 6. The computer system 2 is capable of accessing a 
storage device 8, which may comprise any type of non-volatile storage device known 
in the art, e.g., hard disk drive, tape drive, optical disk system, holographic storage 

25 units, etc. The file system 6 would define the location of parts of files maintained in 
the storage device. The file system 6 would provide a mapping of logical file names 
to physical locations in the storage device 8. The storage device 8 may comprise a 
single storage device or a multitude of storage devices at distributed locations in a 
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network. In such distributed storage environments, the file system 6 would define the 
location of files in distributed storage throughout a network. 

A file system is a logical method for organizing and storing information. The 
file is the smallest unit in which information is stored. A hierarchical arrangement of 

5 directories with respect to a root directory, which is the root node of the hierarchical 
file structure, defines the logical address of files in the system. For instance, in 
UNIX file systems, the root directory is represented by the forward slash character "/", 
Every file and directory in the file system may be identified by a complete list of the 
names of the directories to that file or directory, which is referred to as the pathname 

10 of the file. The pathname includes all directories under which the file is located 
followed by the file name. 

Many file systems include logical and physical components. The logical file 
system is the level of the file system at which users can request file operations by 
system calls that carry out file system requests. The logical file system provides local 

15 name resolution for system calls. Local name resolution allows the logical file system 
to access multiple file system implementations, such as multiple physical file systems, 
through a uniform name space. The physical file system component manages 
permanent storage of data on the storage device 8. A file request would first be 
handled by the logical file system, which would then build a request to access the data 

20 to pass to the physical file system. The physical file system then proceeds to access 
the requested data directly from the storage device 8 using the address information of 
physical data on the storage device 8 to directly address the data on the storage device 
8. 

In preferred embodiments, the operating system 4 uses a hash function 10 to 
25 map the logical file names, e.g., c:\work\patents\file.dat, in the file system 6 to an 

integer hash value in a manner known in the art. In preferred embodiments, the hash 
function 10 is designed as a wide hash to produce a large number of possible hash 
values, e.g., 32,000 to 64,000 different hash values. Such a design would reduce the 
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likelihood that two different file names would have the same hash value. The 
operating system 4 at some point would scan each file name in the file system 6, 
subject each file name to the hash function 10, and produce a hash value for each file 
name. 

The operating system 4 further maintains a hash table 12 in cache memory. 
This hash table 12 may comprise a one dimensional table that includes a one bit entry 
for each possible hash value, wherein the descending entries correspond to ever 
increasing hash values. When scanning the file system 6 during initialization, the 
operating system 6 would apply the hash function 10 to each file name and then set 
the bit in the hash table 12 to "on" at the entry or row number corresponding to the 
integer hash value determined from the hash function 10. For instance, if a file name 
was hashed to "4", then the operating system 4 would turn the fourth entry in the hash 
table 12 to "on," indicating that there is a file name having a hash value of 4 in the 
storage device 8. 

FIG. 2 illustrates logic implemented in the operating system 4 to process 
requests to write data to a file in accordance with the preferred embodiments. Control 
begins at block 100 with the operating system 4 receiving a request to write a subject 
file. The operating system 4 applies (at block 102) the hash function 10 to the file 
name of the received file. If the entry in the hash table 12 corresponding to the 
determined hash value is "on" (at block 104), then this indicates that there is another 
file in the file system 6 that maps to the same hash value as the received file. As 
discussed, in wide hashes, it is unlikely that two files having different names will map 
to the same value. Thus, in most cases, indication that there is a preexisting file in the 
file system 6 mapping to the same hash value likely indicates that this preexisting file 
has the same name as the received file. 

If there is not a file with the same name, i.e., the entry value is "off," then the 
operating system 4 sets (at block 106) the entry in the hash table 12 corresponding to 
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the produced hash value to "on" and adds (at block 108) the received file to the file 
system as a new file. 

If the entry in the hash table 12 for the produced hash value was "on," then the 
operating system 4 searches (at block 1 10) the file system 6 for any files having the 
same name as the received file. If, at block 1 12, it is determined that there is not a file 
in the file system 6 having the same name, then the operating system 4 adds (at block 
108) the received file to the file system as a new file. Otherwise, if there is a file with 
the same name as the received file, then the operating system 4 returns an error 
rejecting the new file (at block 1 14) as the file already exists in the system. Blocks 
1 12 and 1 14 occur if the write request is to write a new file to the system. In such 
case, if a file already exists with the same name, then the request is rejected at block 
1 14. However, if the request is to update an existing file, as opposed to writing a new 
file, then the operating system 4 would overwrite a preexisting file with the same 
name or return an error rejecting the update request if there was no preexisting file 
with the same name in the file system 6 to update. 

In further embodiments, the hash table 12 may comprise multiple columns, 
including entries for different directories in the file system 6. In this way, the hash 
table 12 can be used to obtain file information for multiple directories. Alternatively, 
whenever a new directory/folder is referenced, the hash function 10 is applied and the 
table is updated with the entries for the current directory of interest. 

Preferred embodiments substantially reduce the time needed to write a file, 
especially in archival storage systems where most write operations are for new files, 
and not for preexisting files. Further, with preferred embodiments, time savings are 
even more apparent for very large file systems that are very fragmented, and would 
require even more time to search the file system. Moreover, the implementation of 
the preferred embodiment hash function 10 and table 12 utilizes minimal processor 
and cache resources, as opposed to current systems that use substantial processor 
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resources to scan an entire fragmented file system or systems that require substantial 
tables to store a list of every file in the file system. 



This concludes the description of the preferred embodiments of the invention. 
The following describes some alternative embodiments for accomplishing the present 
invention. 

The preferred embodiments may be implemented as a method, apparatus or 
article of manufacture using standard programming and/or engineering techniques to 
produce software, firmware, hardware, or any combination thereof. The term "article 
of manufacture" (or alternatively, "computer program product") as used herein is 
intended to encompass one or more computer programs and data files accessible from 
one or more computer-readable devices, carriers, or media, such as a magnetic storage 
media, "floppy disk," CD-ROM, a file server providing access to the programs via a 
network transmission line, holographic unit, etc. Of course, those skilled in the art 
will recognize many modifications that may be made to this configuration without 
departing from the scope of the present invention. 

Preferred embodiments were described with respect to accessing the hash 
table when receiving a write request. However, the hash table could be accessed 
when receiving a read request to determine whether the requested file to read is in the 
file system. 

In further embodiments, the preferred embodiment hash table could be used 
whenever a program or system needs to determine the presence of a file in the file 
system or operate on the file. 

Preferred embodiments were implemented using a hash function to convert a 
file name comprised of a character string to an integer value. In alternative 
embodiments, functions other than hash functions may be used to convert a lengthy 
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character string to a single integer values. Alternatively, the function may convert the 
file name to a value other than an integer value. 

The hash table was defined as a single column array, wherein the location of 
the entry in the array indicates the corresponding hash value of the entry. In 
5 alternative embodiments, the table may comprise multiple columns, one indicating the 
value to which the file name was converted and another indicating the presence of the 



In summary, preferred embodiments disclose a system, method, and program 
for processing an input file in a file system, wherein the input file has an input file 

10 name. A function is applied to map the input file name to a value. A data structure is 
processed to determine whether there is a preexisting file in the file system having a 
name that maps, according to the function, to the same value to which the input file 
name maps. Two files that map to a same value according to the function are capable 
of having a same name. 

1 5 The foregoing description of the preferred embodiments of the invention has 

been presented for the purposes of illustration and description. It is not intended to be 
exhaustive or to limit the invention to the precise form disclosed. Many 
modifications and variations are possible in light of the above teaching. It is intended 
that the scope of the invention be limited not by this detailed description, but rather by 

20 the claims appended hereto. The above specification, examples and data provide a 
complete description of the manufacture and use of the composition of the invention. 
Since many embodiments of the invention can be made without departing from the 
spirit and scope of the invention, the invention resides in the claims hereinafter 
appended. 



**Microsoft, Windows, and Windows NT are registered trademarks of Microsoft 
Corporation; AIX, OS/390, and OS/2 are registered trademarks and MVS is a 
trademark of IBM; Unix is a registered trademark of The Open Group; and LINUX is 
30 a trademark of Linus Torvalds. 
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WHAT IS CLAIMED IS: 



1 1 . A method for processing an input file in a file system, wherein the 

2 input file has an input file name, comprising: 

3 applying a function to map the input file name to a value; and 

4 processing a data structure to determine whether there is a preexisting file in 

5 the file system having a name that maps, according to the function, to the same value 

6 to which the input file name maps, wherein two files that map to a same value 

7 according to the function are capable of having a same name. 

1 2. The method of claim 1 , wherein the mapped-to values require fewer 

2 bits of storage than the file names. 

1 3. The method of claim 1, wherein the function is a hash function that 

2 maps the input file name to an integer value, and wherein the data structure includes 

3 an entry for each possible integer value capable of being generated from the hash 

4 function. 



1 4. The method of claim 3, wherein processing the data structure to 

2 determine whether there is a preexisting file comprises determining whether the entry 

3 for the integer value to which the input file name maps indicates the presence of one 

4 preexisting file mapping to the same integer value as the input file name. 

1 5. The method of claim 4, wherein the data structure is a one-dimensional 

2 array and wherein each entry is capable of having one of two values, further 

3 comprising setting the entry to a first value if there is one preexisting file name in the 

4 file system that maps to the integer value for the entry, and wherein determining 

5 whether there is one preexisting file comprises determining whether the entry for the 

6 integer value to which the input file name maps has the first value. 
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6. The method of claim 1, further comprising: 

applying the function to each file name in the file system to map each file 
name to one value; and 

indicating in the data structure, for each file name, that there is one preexisting 
file for the value to which the file name maps. 

7. The method of claim 6, wherein the input file is the subject of an 
access request, further comprising scanning each file in the file system to determine if 
there is at least one preexisting file having the same name as the input file name if 
there is one preexisting file in the file system having a name that maps, according to 
the function, to the same value to which the input file name maps. 

8. The method of claim 7, wherein the access request to the input file is 
to add the input file as a new file to the file system, further comprising: 

adding the input file as a new file to the file system if no preexisting file in the 
file system has the same name as the input file name; and 

rejecting the access request if there is a preexisting file in the file system 
having the same name. 

9. The method of claim 7, wherein the access request to the input file is 
to update a file in the file system with data from the input file, further comprising: 

updating a preexisting file in the file system having the same name as the 
input file with the data in the input file if there is such a preexisting file; and 

rejecting the access request if there is no preexisting file in the file system 
having the same name as the input file name. 
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1 10. A system for processing an input file in a file system, wherein the 

2 input file has an input file name, comprising: 

3 means for applying a function to map the input file name to a value; and 

4 means for processing a data structure to determine whether there is a 

5 preexisting file in the file system having a name that maps, according to the function, 

6 to the same value to which the input file name maps, wherein two files that map to a 

7 same value according to the function are capable of having a same name. 

1 11. The system of claim 10, wherein the mapped-to values require fewer 

2 bits of storage than the file names. 

1 12. The system of claim 10, wherein the function is a hash function that 

2 maps the input file name to an integer value, and wherein the data structure includes 

3 an entry for each possible integer value capable of being generated from the hash 

4 function. 

1 13. The system of claim 10, wherein the means for processing the data 



2 structure to determine whether there is a preexisting file comprises determining 

3 whether the entry for the integer value to which the input file name maps indicates the 

4 presence of one preexisting file mapping to the same integer value as the input file 

5 name. 

1 14. The system of claim 13, wherein the data structure is a one- 

2 dimensional array and wherein each entry is capable of having one of two values, 

3 further comprising setting the entry to a first value if there is one preexisting file name 

4 in the file system that maps to the integer value for the entry, and wherein determining 

5 whether there is one preexisting file comprises determining whether the entry for the 

6 integer value to which the input file name maps has the first value. 



• 
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15. The system of claim 10, further comprising: 

means for applying the function to each file name in the file system to map 
each file name to one value; and 

means for indicating in the data structure, for each file name, that there is one 
preexisting file for the value to which the file name maps. 

16. The system of claim 10, wherein the input file is the subject of an 
access request, further comprising means for scanning each file in the file system to 
determine if there is at least one preexisting file having the same name as the input 
file name if there is one preexisting file in the file system having a name that maps, 
according to the function, to the same value to which the input file name maps. 

17. The system of claim 16, wherein the access request to the input file is 
to add the input file as a new file to the file system, further comprising: 

means for adding the input file as a new file to the file system if no preexisting 
file in the file system has the same name as the input file name; and 

means for rejecting the access request if there is a preexisting file in the file 
system having the same name. 

18. The system of claim 16, wherein the access request to the input file is 
to update a file in the file system with data from the input file, further comprising: 

means for updating a preexisting file in the file system having the same name 
as the input file with the data in the input file if there is such a preexisting file; and 

means for rejecting the access request if there is no preexisting file in the file 
system having the same name as the input file name. 
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19. An article of manufacture for processing an input file in a file system, 
wherein the input file has an input file name, the article of manufacture comprising 
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computer usable media including at least one computer program embedded therein 
that causes the computer to perform: 

applying a function to map the input file name to a value; and 
processing a data structure to determine whether there is a preexisting file in 
the file system having a name that maps, according to the function, to the same value 
to which the input file name maps, wherein two files that map to a same value 
according to the function are capable of having a same name. 

20. The article of manufacture of claim 19, wherein the mapped-to values 
require fewer bits of storage than the file names. 

21 . The article of manufacture of claim 19, wherein the function is a hash 
function that maps the input file name to an integer value, and wherein the data 
structure includes an entry for each possible integer value capable of being generated 
from the hash function. 

22. The article of manufacture of claim 21, wherein processing the data 
structure to determine whether there is a preexisting file comprises determining 
whether the entry for the integer value to which the input file name maps indicates the 

4 presence of one preexisting file mapping to the same integer value as the input file 

5 name. 

1 23. The article of manufacture of claim 22, wherein the data structure is a 

2 one-dimensional array and wherein each entry is capable of having one of two values, 

3 further comprising setting the entry to a first value if there is one preexisting file name 

4 in the file system that maps to the integer value for the entry, and wherein determining 

5 whether there is one preexisting file comprises determining whether the entry for the 

6 integer value to which the input file name maps has the first value. 
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24. The article of manufacture of claim 19, further comprising: 
applying the function to each file name in the file system to map each file 

name to one value; and 

indicating in the data structure, for each file name, that there is one preexisting 
file for the value to which the file name maps. 

25. The article of manufacture of claim 24, wherein the input file is the 
subject of an access request, further comprising scanning each file in the file system 
to determine if there is at least one preexisting file having the same name as the input 
file name if there is one preexisting file in the file system having a name that maps, 
according to the function, to the same value to which the input file name maps. 

26. The article of manufacture of claim 25, wherein the access request to 
the input file is to add the input file as a new file to the file system, further 
comprising: 

adding the input file as a new file to the file system if no preexisting file in the 
file system has the same name as the input file name; and 

rejecting the access request if there is a preexisting file in the file system 
having the same name. 

27. The article of manufacture of claim 25, wherein the access request to 
the input file is to update a file in the file system with data from the input file, further 
comprising: 

updating a preexisting file in the file system having the same name as the 
input file with the data in the input file if there is such a preexisting file; and 

rejecting the access request if there is no preexisting file in the file system 
having the same name as the input file name. 
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METHOD, SYSTEM, AND PROGRAM FOR 



ACCESSING FILES IN A FILE SYSTEM 



ABSTRACT 



Disclosed is a system, method, and program for processing an input file in a 
file system, wherein the input file has an input file name. A function is applied to 
map the input file name to a value. A data structure is processed to determine 
whether there is a preexisting file in the file system having a name that maps, 
according to the function, to the same value to which the input file name maps. Two 
files that map to a same value according to the function are capable of having a same 
name. 
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